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Abstract. Global constraints proved themselves to be an efficient tool for 
modelling and solving large-scale real-life combinatorial problems. They 
encapsulate a set of binary constraints and using global reasoning about this set 
they filter the domains of involved variables better than arc consistency among 
the set of binary constraints. Moreover, global constraints exploit semantic 
information to achieve more efficient filtering than generalised consistency 
algorithms for n-ary constraints. Continued expansion of constraint 
programming (CP) to various application areas brings new challenges for 
design of global constraints. In particular, application of CP to advanced 
planning and scheduling (APS) requires dynamic additions of new variables 
and constraints during the process of constraint satisfaction and, thus, it would 
be helpful if the global constraints could adopt new variables. In the paper, we 
give a motivation for such dynamic global constraints and we describe a 
dynamic version of the well-known alldif f erent constraint. 

Keywords: planning, scheduling, constraint propagation, global constraints, 
alldif f erent constraint 



1 Introduction 

Constraint programming (CP) is successfully applied to real-life combinatorial 
(optimisation) problems thanks to its declarative character, which supports natural 
modelling of real-life problems, and thanks to general solving technology, which can 
encapsulate various solving techniques. One of the main features of CP is locality of 
the problem description i.e. we model the problem using a set of constraints and most 
of the constraints bind a small set of variables which is much smaller than the set of 
all variables in the problem. This is different from the traditional operation research 
(OR) approach where the "constraints" bind all the variables and thus, OR solving 
methods can exploit global reasoning about the problem. On the other hand, global 
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reasoning can be very expensive and a simple method of constraint propagation, 
pruning, filtering or whatever you call it, can reduce the search space more efficiently. 

The goal of constraint propagation is to achieve some level of consistency in the 
network of constraints and variables by removing inconsistent values from variables' 
domains (inconsistent values cannot take part in any solution). Achieving a higher 
level of consistency leads to removing more inconsistent values but it is more 
expensive in terms of time and space. Consequently, a simple arc consistency or its 
generalised version for n-ary constraints is usually used. Application of CP to many 
real-life problems shows that a good trade-off between efficiency and level of 
consistency can be achieved by using global constraints instead of the sets of binary 
constraints [7]. 

A global constraint encapsulates several simple constraints and by exploiting 
semantic information about this set of constraints it can achieve better pruning of 
domains. Filtering algorithms for global constraints are based on methods of graph 
theory, discrete mathematics, or operation research so they make the bridge between 
these mathematical areas and search-based constraint programming with origins in 
artificial intelligence. However, the traditional global constraints require all the 
constrained variables to be known before the constraint is posted to the system. This 
feature makes using of global constraints more complicated in areas where new 
variables are generated during the course of solving. This difficulty can be solved 
using dummy variables that represent slots for variables to come. Unfortunately, this 
approach cannot be used if large number of dummy variables is required because it 
decreases efficiency of the filtering algorithm and it increases memory consumption. 

In Section 2, we give some real-life motivated examples from advanced planning 
and scheduling to justify adding new variables during the course of problem solving. 
To remove difficulties with the dummy variables we propose a concept of dynamic 
global constraints that can adopt new variables during solving. In Section 3, we 
introduce a monotonic feature of the global constraints and then we describe how 
arbitrary monotonic global constraint can be adapted to a dynamic environment. This 
approach is based on deactivating the global constraint and posting a new global 
constraint with an extended set of variables. This is a general method but it requires 
the extended constraint to build up own data structures from scratch. Therefore, we 
propose to include the dynamic character into the filtering algorithm for the global 
constraint. In Section 4 we describe such a filtering algorithm for the dynamic 
alldif ferent constraint. We conclude with a complexity study confirming that 
the dynamic filtering is more efficient in terms of time and space than re-posting the 
constraint. 



2 Motivation 

Scheduling is one of the most successful application areas of constraint programming 
and many global constraints were proposed for scheduling problems [7]. These global 
constraints are static in the sense of knowing all the constrained variables in advance. 
This is not a problem in the conventional formulation of scheduling problems where 
all the scheduled activities are known in advance and, thus, it is possible to generate 



all the variables and to post all the constraints before we start search for the solution. 
However, the static problem formulation is less appropriate for planning under 
resource constraints [2,4], where the activities are introduced during the course of 
solving. The static approach with dummy activities cannot be used there because the 
number of alternatives, i.e., the number of dummy activities, is very large which 
decreases performance (and sometimes it is even impossible to generate all the 
alternatives due to memory restrictions). We have observed similar difficulty when 
doing scheduling in complex process environments. The following section shows 
some examples when dynamic introduction of activities is necessary, for details and 
more examples see [1,2]. 

2.1 Process-dependent activities 

In process production, the relations between activities are very complex and, in many 
cases, it is hard to express them in a mathematical way. So-called process-dependent 
activities are perhaps the main difficulty here, because the existence of such activity 
depends on allocation of other activities. Consequently, these activities cannot be 
introduced in advance and the global constraints that involve them cannot be posted 
before we know all the involved activities. Again, the static model with dummy 
activities cannot be used if the number of alternatives is large. 

Typical examples of process-dependent activities can be identified in chemical, 
food, or steelmaking industries where it is necessary to insert special set-up, cleaning, 
or re-heat activities between the production activities [1,2]. In many scheduling 
systems, set-ups are modelled by transition times between two consecutive activities. 
Unfortunately, this model cannot be applied when set-up activities produce some low- 
quality products that must be stored or consumed by other resources'. In [5] another 
example of process-dependent activity is studied, in particular re-heat activity. Again, 
we need a special activity to be introduced because the re-heat activity consumes 
resource capacity so it must be scheduled (the re-heat activity is constrained by other 
activities scheduled to the same resource. 



Fig. 1. Set-up (left) and re-heating (right). In both cases a special activity (striped rectangle) is 
necessary because this activity consumes resource capacity and it is connected to activities in 
other resources. 



' Typically, these so-called by-products are not assumed in scheduling systems, which may 
cause problems with storing if a big quantity of by-products appear. Moreover, the by- 
products can be used in further production as raw material that may decrease the production 
cost. 




3 Making the constraints dynamic 

When constraint programming is applied to solving problems, a traditional static 
formulation of the problem is used: first, introduce all the variables, then post all the 
constraints, and finally label the variables. This schema works if we known all the 
objects in advance but the static schema is less appropriate when new objects 
(variables and constraints) appear during the process of variable labelling. This is a 
natural way of solving problems in Constraint Logic Programming (CLP) systems 
where labelling can be interleaved with introduction of new variables and constraints 
[3]. To implement this we need an incremental constraint solver that can accept new 
variables and constraints and that can remove them upon backtracking. Last In First 
Out (LIFO) mechanism for variable and constraint addition/retraction is used which is 
not complicated to implement using a stack and thanks to monotonicity of constraint 
systems^. In the rest of the paper we assume that constraints and variables are added 
to/removed from the consttaint store in LIFO manner. 

The LIFO mechanism can be applied to adding/removing variables to/from the 
dynamic global constraints as well. Note that at this stage we are not speaking about 
frilly dynamic global consttaints where the set of variables and their domains change 
arbitrary or this change is forced from external enviroimient (on-line algorithms). We 
describe global constraints where it is possible to extend the set of variables 
incrementally during the course of solving (this extension is caused by the current 
partial solution) and to remove the variables in LIFO manner upon backtracking. 

Moreover, we require the global constraint to behave monotonically, i.e., if we add 
a new variable to the constraint then the solution set does not enlarge. This is a feature 
of global constraints that encapsulate a set of binary consttaints like the 
alldif f erent consttaint (such global consttaints can be decomposed to the set of 
binary consttaints over the original variables). However, there also exist global 
consttains which are not monotonic, like the at least global consttaint (at least a 
given number of variables take a given value). To grasp formally the monotonicity 
feature, we inttoduce monotonic global consttaints. 

Definition 1 : Let Sol(C(X)) be a set of solutions for the global consttaint C 
over the set of variables X. We call the global constraint C monotonic if for 
arbittary variable x the following monotonicity property holds: 

SoI{C{Xkj{x})) c Sol{C{X)). 

Note that in the above definition and in the entire paper we expect that global 
constraint can be defined over arbitrary (but finite) set of variables. We now show 
how arbitrary monotonic global consttaint can be extended to a dynamic version that 
allows adding/removing new variables in LIFO maimer. 

Let glob((X,, XJ) be a global constraint over the set of variables (Xj, XJ. To 
capture the order of adding variables to the dynamic global constraint, we will use a 
list of variables [Xj,..., XjJ instead of the set. When a new variable is added to the 
consttaint then it is added to the end of this list; a variable can be removed from the 



^ Let Sol{C} be a set of solutions for the set of constraints C. Then for arbitrary constraint c 
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constraint only if it is at the end of the list (LIFO principle). To define the dynamic 
version of the global constraint glob dyn([Xj,..., XJ) we need the algorithms for 
adding a new variable to the constraint and for removing the last added variable from 
the constraint upon backtracking. When adding/removing the first variable to/from the 
dynamic constraint we can skip step 1 and step 3 respectively in the following two 
algorithms. Note also that the algorithms work explicitly with the stack (step 2) - this 
is just to illustrate the track of the algorithms (or to implement them in imperative 
languages), in CLP systems this is done automatically by the underlying backtracking 
mechanism. In fact, in the CLP system removing a variable from the global constraint 
is done during backtracking through the procedure for adding the variable. Thus, the 
progranmier uses Add Variable in the CLP code (it is like posting a constraint), and 
when backtracking through this call, the variable is removed from the constraint. We 
include RemoveVariable just to illusfrate the reverse process for AddVariable, 
this is not a real procedure that is used explicitly in the code. 

Algorithm 1: AddVariable (glob_dyn ( [Xi, X^] ) , X^_:) 

1) deactivate glob ( {Xi, X^}), i.e., push its internal data 
structures to the stack and stop propagation through this 
constraint (if k>l, otherwise do nothing) 

2) push domains of X^,..., Xj,, X]j+i to the stack 

3) post glob ( {Xi, X]j, X]j+i}) to the constraint store 

Algorithm 2: RemoveVariable (glob_dyn ( [Xi, X,^] ) ) 

1) remove glob ( {X^, Xj,}) from the constraint store 

2) restore domains of X^,..., X]j from the stack 

3) re-activate glob ( {X^, X]j_i}) , i.e. restore its internal 
data structures from the stack and activate propagation 

The above algorithms exploit the monotonicity feature of the global constraint, i.e., if 
we add a new variable then the domains of already involved variables remain the 
same or the domains are reduced. We also expect that the variables and constraints are 
added/retracted in LIFO order, which is not a problem in CLP systems. Note also, that 
to improve efficiency we can add a set of variables together to the constraint but, then, 
this set is removed only from the constraint upon backtracking (it is not possible to 
remove a single variable from this set etc.). Still, there is hidden inefficiency: 

1) we store internal representation of the global constraints after each variable 
addition (so we duplicate some data structures, which may increases memory 
consumption), 

2) the dynamic constraint after adding a new variable must build its internal 
representation from scratch which decreases time efficiency. 

The above two difficulties can be eliminated if the global consfraint is implemented 
dynamically from beginning, i.e., if it allows adding new variables (and removing 
upon backfracking). We believe that at least some global consfraints can 
accommodate such dynamic behaviour as we show in the next section for the 
alldif ferent consfraint. 



4 The dynamic alldif f erent constraint 



The alldif f erent constraint is atypical example of monotonic global constraint 
that exploits semantic information to achieve better domain filtering. The 
alldif ferent constraint can be defined over arbitrary finite set of variables and it 
ensures that the variables have different values. 

Definition 2: The alldif ferent constraint for the set of variables X],..., Xj^ 
is defined by the set of tuples (di,..., d^) such that Vi diSDj, where Dj is the 
domain of the variable Xj, and Vi?tj d; ^ dj. 

alldif ferent (Xi,...,XO= {(di,..., dO I Vi djeD; & Vi?ij dj^tdj} 

Naturally, instead of using the alldif ferent constraint, one may post the set of 
binary difference constraints - for each pair of variables Xj, Xj the constraint Xj Xj is 
defined. Then there is no problem when a new variable is added, we simply post the 
binary difference constraints between the new variable Xj^+j and all the previous 
variables Xi,..., Xj^ (thus the alldifferent constraint is monotonic). On the 
other side, the alldifferent constraint can remove more incompatible values 
than the set of binary constraints as Figure 2 shows. 
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Fig. 2. The left constraint graph is arc-consistent so no value is found to be inconsistent. 
Clearly, the values a and h cannot be assigned to the variable X3 so they can be removed. The 
alldifferent constraint (right) removes these values. 



4.1 Static implementation 

The efficient implementation of the alldifferent constraint was proposed in [6]. 
This implementation is based on matching theory, in particular on matching over 
bipartite graphs. The bipartite graph for the alldifferent constraint is called a 
value graph and it is defined in the following way: 

Definition 3: Given an alldifferent constraint C, the bipartite graph 
GV(C) = (Xc, D(Xc), E), where Xc is a set of variables in C, D(Xc) is a union of 
domains D; for all variables in Xc and (Xi,a)e E iff a e Dj, is called a value 
graph of C. 



Fig. 3. A value graph for the alldif f erent constraint from Figure 2. 

The filtering algorithm for the alldifferent constraint computes the maximal 
matching and removes edges that are not part of any maximal matching. Note that 
removing an edge from the value graph is equivalent to removing a value from the 
variable domain. Moreover, if the maximal matching does not cover all the variables 
from the alldifferent constraint then the consfraint fails (it is not possible to 
find a consistent labelling of variables). 

Algorithm 3: AllDiff- Initialisation (C) 

1) build G = (Xc, D(Xc), E), 

2) M(G) <— ComputeMaximumMatching (G) 

3) if |M(G)|<| Xc I then return false 

4) RemoveEdgesFromG (G, M (G) ) 

5) return true 

The procedure RemoveEdgesFromG deletes every edge that does not belong to any 
matching which covers Xc. Such edges are found by exploring even alternating paths 
and cycles. The description of linear algorithm can be found in [6]. 

Naturally, the constraint systems consist of more than single alldifferent 
consfraint and the other consttaints may reduce the domains of variables from Xc as 
well. We can repeat the AllDiff- Initialisation procedure each time a domain of 
a variable from Xc is changed (a value is deleted) but we can do better by using the 
fact that before the deletion, a matching which covers Xc is known. The algorithm 
proposed in [6] uses a fimction MatchingCoveringX(G, Mi, M2), which computes a 
matching M2, which covers Xc, from a matching Mi, which is not maximal. If no 
such matching exists then the procedure returns false. We present here a slightly 
simplified version of the algorithm from [6] (we expect that when an edge (X,a) is 
removed from the graph then the value a is not the only value for the variable X, 
otherwise the consfraint that causes such reduction has already failed). The algorithm 
gets the value graph G, the maximum matching M(G), and the list of edges ER to 
delete as input. It returns false if there is no maximum matching which covers Xc, and 
it returns true otherwise and deletes every edge that does not belong to any matching 
which covers Xc. 



Algorithm 4: AllDiff-Propagation (G, M (G) , ER) 



1) 



computeMatching <— false 



2) 



for each eeER do 



3) 



if eeM(G) then 



4) 



M(G) <- M(G) - {e} 



5) 
6) 
7) 



computeMatching i— true 



remove e from G 



8) 
9) 
10) 



if computeMatching then 

if -iMatchingCoveringX (G, M (G) , M ' ) then 



return false 



else 



11) 



M(G) M 



12) RemoveEdgesFromG(G,M(G) ) 

13) return true 



4.2 Dynamic extension 

As we mentioned in Section 3, by a dynamic global constraint we mean a constraint 
whose set of variables can be extended and shrunk in LIFO manner. Thus, in the 
following we concentrate on the algorithm for adding a new variable to the constraint. 
We expect that the variable can be removed upon backtracking only (and the 
underlying system restores the data structures to the state just before the variable was 
added). 

Remind that the alldif ferent constraint is monotonic so we can add a new 
variable (or a set of variables) to the constraint without extending the solution set. 
Moreover, we can incrementally extend the value graph to get a value graph for the 
constraint with more variables. In fact we are extending the set Xc of variables, the set 
D(Xc) of values (perhaps), and the set E of edges. The new edges connect only the 
new variables with values (old or new); there is no new edge connecting any old 
variable with any value (we are not extending the domains of the old variables so we 
keep monotonicity). 

Definition 4: Let (X, D(X), E) be a value graph of the alldifferent 
constraint C(X) for the set X of variables. Then the bipartite graph (XuY, 
D(XuY), E') where Y is set of added variables and E' = E u {(Xi,a) | Xj e Y & a 
e Dj, } is called an extended value graph of C(XuY) for the extended set XuY 
of variables. 

The important thing is that the extension of the variable set does not influence the 
decisions taken before. In particular, if any edge is deleted from the original value 
graph (because it does not belong to any matching which covers X) then this edge 
does not belong to any matching which covers XuY (the constraint is monotonic). 



This observation is used in the algorithm that updates the value graph after adding 
new variables. It means that we can incrementally update the value graph after adding 
new variables instead of computing a new value graph from scratch. 




Fig. 4. Edges deleted (dotted edges) from the original value graph (left) do not belong to the 
extended value graph (right). Bold edges are the maximum matching edges. 

After extending the original value graph by adding new edges, the former maximum 
matching does not cover the extended set XuY of variables. We can use the function 
MatchingCoveringX to extend the matching which covers X to a matching which 
covers XuY. If there exists a maximum matching which covers XuY then the edges 
that do not belong to any maximum matching are removed using RemoveEdgesFromG 
and the algorithm returns true, otherwise it returns false. 

Algorithms: AllDiff-Update (G, M (G) , EA) 

1) for each esEA do 

2) add e to G 

3) if -iMatchingCoveringX(G,M(G) ,M' ) then 

4) return false 

5) else 

6) M(G) <r- M' 

7) RemoveEdgesFromG (G, M (G) ) 

8) return true 

Removing a variable from thealldifferent consfraint is done upon backttacking 
only so we do not present a special algorithm for this. The standard mechanism with a 
stack to recover data structures can be used there. Initialisation and propagation 
algorithms for the dynamic alldif f erent consfraint are the same as for the static 
version, i.e.. Algorithm 3 and Algorithm 4. 



5 Complexity Analysis 



Besides the dynamic filtering for the alldifferent constraint (presented in 
Section 4.2) we can use a generic dynamisation technique proposed in Section 3. Let 
us now compare the complexity of these two methods for making the 
alldifferent constraint dynamic. We will use the basic complexity results from 
[6]. 

Assume that p is a number of variables in the constraint and d is a number of all 
different values in the domains of these variables (a size of the union of the domains). 
Thus p+d is a number of vertices in the value graph. Let mhe a number of edges in 
the value graph, clearly m<pd (the value graph is a bipartite graph). 

Space complexity. To represent the alldifferent consfraint we need keeping its 
value graph. The graph can be represented by the set of its edges so the space 
complexity is 0(m) i.e., 0(pd). If a generic dynamisation technique is used then a new 
value graph is infroduced (and the previous value graph is kept in memory) after 
adding a new variable. Thus, space complexity of adding a new variable is 0(pd). 

In case of dynamic filtering algorithm, only new edges are added to the value 
graph when new variable arrives. These edges can only coimect the new variable with 
the values, so maximal number of new edges is d. Thus, space complexity is 0(d), 
jp-times better than generic dynamisation. 

Time complexity. According to [6], time complexity of AllDiff-Mtialisation is 
0{dp~^p). Thus, time complexity of adding a new variable using the generic 
dynamisation technique is 0{dp'^p) as well (in fact, we are adding a new constraint). 

Time complexity of RemoveEdgesFromG is 0{m+p+d) [6] so we can use 0{pd) 
instead. Time complexity of MatchingCoveringX is O(m-^k), where k is a number 
of edges missing in the maximal covering (these edges must be added to find a 
covering which covers all the variables) [6]. Note that if we are adding a new variable 
then exactly one edge is missing in the maximal covering - the edge connecting the 
new variable with some value. Consequently, time complexity of 
MatchingCoveringX called in AllDiff-Update is 0(m), that is 0(pd). Together, 
time complexity of adding a new variable using AllDiff-Update is 0(pd), V/?-times 
better than generic dynamisation. 

However, note that if we know the variables in advance, it is more efficient to add 
them all together, time complexity is 0{dp~^p), than adding them incrementally (one 
by one), time complexity is 0{dp^). Our algorithm supports adding more variables 
together in an efficient way with time complexity 0{dp~^k), where A; is a number of 
added variables. 

Time complexity of propagation of deletions (a value is removed from the domain 
of a variable by another consfraint) through the consfraint is 0{pd) [6], same for both 
methods of dynamisation. Nevertheless, note that some systems do not support 
deactivating the consfraint from the consfraint store - the consfraint is removed upon 
backfracking only. Consequently, when generic dynamisation is used then all the 
consfraints posted so far are active and propagation is duplicated, which decreases 
overall efficiency. 





SPACE 


TIME 


AddVartable(AllDtff) 
generic dynamisation 


Oipd) 


0{dp<p) 


AllDtff-Update 
dynamic all-dijf event 


0(d) 


0{dp) 



Table 1. Comparison of time and space complexity of adding a variable for the generic 
dynamisation and the dynamic implementation of the alldif f erent constraint. 



6 Conclusions 

Wider and wider application area of constraint programming brings new challenges to 
constraint satisfaction algorithms. Dynamisation of global constraints, i.e., extending 
a global constraint to work with the changing set of variables, is one of the desirable 
features. In the paper we give some examples when a dynamic approach to constraint 
satisfaction problem is necessary. We argue here for using dynamic global constraints 
which provide good domain filtering and which can adopt new variables if necessary. 
We showed a general mechanism for dynamisation of global constraints and we 
presented a dynamic version of the alldif ferent constraint. We also proved that 
the dynamic version of the alldif ferent constraint is more efficient in terms of 
time and space than re-posting a constraint each time a new variable arrives (generic 
dynamisation). 
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